Advanced Email Scraper

• created: 01/16/2016
• latest update: 01/20/2016
• by: Xerone IT
• codecanyon.net/user/xeroneitbd
• email: konokronok@gmail.com

Thank you so much for purchasing this application. If you have any question that are beyond the scope of this help file, please feel free to check our support instructions:
http://codecanyon.net/item/advanced-email-scraper/14490067/support

Advanced Email Scraper is a web based tool to extract emails by various techniques (website crawl, URL crawl, search in Google/Bing, searcn in text file), check email validation (pattern, MX record) , search for whois data, filter your email list by removing duplicate emails, check web page status .It is designed carefully so that you can install & use it very easily.

This tool supports multiple users and all of your users can also use this tool likely.

1. User management
2. Full website crawling (no subdomain)
3. URL crawling (bulk upload)
4. Search in Google, Bing with keywords (proxy is recommended)
5. Whois search (bulk)
6. Search intext file (bulk file upload)
7. Email validation check (pattern, MX)
8. Email filtering (remove duplicate email)
9. Bulk page status check (56 HTTP code)

1. Download .zip package
2. Upload it to your server
3. Extract the package (make sure all the folders have write permission & your server has cURL ebabled.)
4. Run the uploaded url via browser (http://yourdomain.com/sub1/sub2/.../aes/) and you will find this interface. Here you have to provide the settings for AES:
   • Hostame : database host name / IP
   • Database Name : create a mysql database for AES on your host and write that name here
   • Database username  : username of the created database
   • Database password : password of the created database
   • AES Admin Panel Login Email : this email will be used to login as admin
   • AES Admin Panel Login Password : password to log in as admin
   • Company Name and Company Address
   • Company Phone /  Mobile
   • 
5. Click Install AES Now Button
6. You are done. Log in with your admin email and password and start using AES.

You will see similar types of interface everywhere because our design team tried to make the whole interface easy to learn and remember. So, if you know what is where in this interface below, you can explore a lot very easily.

1. It's the main navigation. You will find every link here.
2. Clicking here an user can change his/her password or can sign out.
3. In this area you will find functionalities like new search/ download.
4. You will find some pages with data loaded in a nice data-grid. You can filter the shown data by searching.
5. Data are always loaded with pagination for better performance. You will find the pagination information here and can manipulate pagination options.
6. It's called the the "Action Area". If you want to view / edit / delete etc a record in data-grid you have to use the action area.

• Go to  "General Settings"
• Click it and you will find a form to customize the settings.
• This is the place where you can change the logo & favicon also.
• Here is the snapshot.Happy customization
   

• This tool can be used by multiple users.
• Go to User Management.
• You can search, add, edit, enable/disbale, delete your users.
• You can create two types of user : admin & member. Admin level users will have all the permissions like you and the members can use every module of AES except general settings & user management.

• Collecting email from a website is now super easy.
• Go to Crawl Website > New Search
• You just need to put the domain name and hit Start Scraping button. The system then start to crawl all links of this website and collect all email address. The progress of each links will be displayed after completing with found email.
• At the end you’ll get all urls and email address which is fetched from the website. You can download email list and url list then.
• Also these scraping information will be stored in the database and you can access it anytime. Here you will find advance search option also.
• Please note that this tool can’t read date which is displayed with Javascript or with auto search. Some websites crawling needs to use proxy. So there is optional option to use proxy. If you think proxy is needed to crawl the site, use proxy.

• If you want to scrap specific url not the full website, then this option is appropriate.
• The system supports multiple url crawling at a time.
• Go to Crawl URL> New Search.You can simply type URLs in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
• Then hit Search button and searching will start .
• You can download email address after completion.
• The scraping information will be stored in the database and you can access it anytime through landning page of Crawl URL.

• Search engine is the greatest place for getting email address. To search for emails in search engines go to Search in Search Engine > New Search
• Search engines provide results depending on keyword. So you need to put your keyword.
• Then select your search engine (Google or Bing).
• The email addresses come from some popular social networks usually. Select your social network from where you want to collect.
• Then select the email provider like gmail, yahoo, outlook. It means which provider’s email you want.
• Download your desired email list.
• Important: Crawling in Google or Bing is very sensitive. They may band or block your IP for  continuous crawling. So we strongly recommend you to use proxy during Google or Bing search. Our system supports proxy system with very easy interface.
• The scraping information will be stored in the database and you can access it anytime through landning page of Search in Search Engine.

• Let, you have a lot of text files in your hard drive where email may exist.
• This feature will help you to search in those files and collect emails.
• You can aslo upload multiple files at a time, browse them and hit Start Searching.

• After completion  you can download the result.

• If you need any domain's whois information like admin email, technical email, nameserver, registration date, sponsor, expiry date, then here is the solution.
• It supports bulk domain search. you can simply type domains in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
• Hit Start Searching and after completion download the result.
• The searching information will be stored in the database and you can access it anytime through landning page of Whois Search.

• Check emails are valid or not.
• AES supports  well pattern matching and MX record for checking valid emails.
• AES does not support SMTP validation becasue there are some drawbacks to use SMTP validation. Most of the SMTP servers take it as spam and we get wrong wrong result.
• You can simply type emails in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
• Hit Start Searching and after completion download the result.

• This is a very simple technique to remove duplicate emails and make your email list unique.
•  You can simply type emails in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
• Hit Start Searching and after completion download the result.

• Let you have a lot of URLs of domains.
• You may need to check the status of all URLs.
• Some of the URLs may be down or not found or broken.
• AES handles all 56 HTTP code responses and give you exact status & HTTP response code.
• It will also return connected time, download speed, name lookup time etc.
•  You can simply type URLs in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
• Hit Start Searching and after completion download the result.
• The searching information will be stored in the database and you can access it anytime through landning page of Page Status Checker.

2. Backup your current application files (v1.0) and export current database as sql (as pre-caution).

3. Replace the following files taking from v1.1

Link: http://webprogrammings.net/demo/aes/

Login credentials
Username: admin@gmail.com
Password: admin
 

Thanks so much to

• CodeIgniter
• GroceryCrud
• jQuery
• jQueryUI
• jQuery EasyUI
• PHP Whois
• ckEditor
• Morris JS
• Admin LTE
• Bootstrap
• FontAwesome
• Documenter

Thank you so much for purchasing this application. If you have any question that are beyond the scope of this help file, please feel free to check our support instructions:
http://codecanyon.net/item/advanced-email-scraper/14490067/support

©Xerone IT , made with Documenter v2.0